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Near-infrared (NIR) spectroscopy has been widely reported for its useful 
applications in assessing internal fruit qualities. Motivated by apple 
consumption in the global market, this study aims to evaluate the possibility 
of applying NIR imaging to detect slight bruises in apple fruits. A simple 
optical setup was designed, and low-cost system components were used to 
promote the future development of practical and cost-efficient devices. To 
evaluate the effectiveness of the proposed approach, slight bruises were 
created by a mild impact with a comparably low impact energy of only 
0.081 Joules. Experimental results showed that 100% of bruises in Jazz and 
Gala apples were accurately detected immediately after bruising and within 


Fresh 3 hours of storage. Thus, it is promising to develop customer devices to 
Low-cost detect slight bruises for not only apple fruits but also other fruits with soft 
Mild bruises and thin skin at their early damage stages. 
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1. INTRODUCTION 

Despite the intermittent decline in apple consumption, apples are still among the most consumed 
fruits in the global market, partly because they are rich in antioxidants and have high nutraceutical values. 
Apple fruit is highly vulnerable to external impact from falling or distortion in various stages and processes 
related to harvesting and postharvest handling [1]. The resulted bruising will alter the flavor, the color and 
textural properties of the fruit [2] that affect the consumer’s acceptance of the fresh fruit [3]. However, 
manual assessment of apple fruits, one of the most common quality assessment methods, is not very accurate 
and time-consuming [4]. Therefore, it is necessary to develop bruise-detecting tools at postharvest facilities. 

In the past two decades, many noninvasive approaches have been proposed for apple bruise 
detection, such as chlorophyll fluorescence imaging [5], deep learning based on 3D deep features [6], 
structured-illumination reflectance imaging [7], Raman spectroscopy [8], X-ray computed tomography [9], 
near-infrared (NIR) imaging in various spectral bands from visible-near to thermal infrared spectral ranges 
[2], [10]-[16]. Because NIR spectra contain information about the major C-H, O-H, and N-H bonds [17]-[19] 
besides water absorption wavelengths crucial for bruise detection, NIR spectra might reveal valuable 
information for fruit quality analysis. Therefore, getting full benefits of hyperspectral information in the 
visible near-infrared (Vis-NIR) or infrared (IR) range has attracted much interest and promote classification 
solutions with higher accuracy. By selecting optimal wavelengths in the spectral range from 401 to 1037 nm, 
bruise detection for apples could be achieved as high as 97.5% [20]. However, hyperspectral imaging or 
imaging in the IR spectral range requires sophisticated and high-cost cameras that will not be feasible for 
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developing cost-efficient commercial grading applications or consumer-grade devices. Thus, low-cost 
multispectral sensors are gaining research focus [17], [21], and [22]. 

Detecting bruises at the early stages is an interesting postharvest problem to reduce the cost incurred 
in transportation, storage, and shortened shelf-life. Early detection approaches were evaluated with apples 
immediately after being subjected to a bruising experiment [7], [10], and [23]. However, few studies focused 
on slight bruises with well-defined impact levels, partly due to no standard method currently available for 
assessing the severity of fruit bruising [24]. A controlled bruise was considered a slight bruise if it was 
difficult to recognize based on its texture and color [23]. Such definition was subjective and might result in 
inconsistent classification of impact levels. Thus, it will be advantageous to specify a quantitative limit of 
bruise detection for reliable implementation of a bruise detection system because the bruise characteristics 
depend on various mechanical parameters such as drop height, impact force, and impact energy [15]. 

In a preliminary effort to develop cost-efficient devices for apple bruise detection, the paper presents 
the detection results of slight bruises in apples in their early stages using a simple imaging setup with cost- 
efficient IR imaging components. The slight level of apple bruises was quantitatively characterized in a 
comparative analysis to facilitate future practical applications such as automatic fruit sorting reported in [25]. 


2. RESEARCH METHOD 
2.1. Experimental setup 

In this study, the apples were initially subjected to a bruising experiment designed to create 
comparably slight bruises. Then, NIR imaging of the apples was performed after different storage times to 
evaluate the effectiveness of the proposed approach for the early detection of apple bruises. 


2.1.1. Bruising experiment setup 

There are two basic bruising techniques which are pendulum-based method and drop test that could 
be applied for various kinds of fruit [26]. The pendulum-based method involves hitting the apple with a 
pendulum arm [7], [9], [14], [24], [27], [28]. Therefore, the impact energy (i.e., the kinetic energy) could be 
adjusted by changing the releasing angle of the pendulum arm. In the drop test, bruises could be generated by 
dropping the fruit to a contact surface [13], [23], [29]-[32] or by releasing a small steel ball to the fruit from a 
specific height [26], [33]-[36]. Because the impact energy computed as the potential energy that depends on 
the weight of the dropped object, a consistent impact level could be achieved for weight-varying apples by 
dropping a specific steel ball to the apples. In addition, a slight adjustment of the impact energy (i.e., the 
potential energy) could be easily performed by changing the drop height. Therefore, this method was utilized 
in this study. 

As illustrated in Figure 1, a 55 gram steel ball (23.7 mm in diameter) was dropped at a specific 
height h above the apple to generate bruises. A 29 mm inner diameter pipe was used to guide the steel ball to 
impact the equatorial region of the apple. The ink used to mark the impact region was invisible with NIR 
imaging so that the round mark would not affect the results of bruise detection. 


29 mm inner 
diameter pipe 


23.7 mm diameter 
steel ball = vd 


drop height » 


impact 
region 


Figure 1. Setup for bruising an apple 


With this setup, the impact energy is the potential energy of the steel ball. Thus, the drop heights of 
150 and 300 mm correspond to the impact energy of 0.081 and 0.162 J, respectively. Table 1 shows the 
relationship between the applied impact energy and the qualitative level of visual perception of the induced 
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bruises reported in [37]. A comparison of slight bruise definitions in other studies is tabulated in Table 2. 


According to these studies, the chosen drop height at 150 mm ensures slight bruises for this study. As shown 
in Figure 2(a)-(b), the bruises were challenging to be recognized. 


Table 1. Impact levels applied on apple fruits [37] 


Impact level Impact energy (J) Description Sources of impact 
1 0.05 The lowest impact level that is close to the bruise Handling and transporting 
detection limit 
2 0.10 Visible, easily perceivable damages Handling and transporting and 
mechanical harvesting and sorting 
3 0.19 Visible, easily perceivable damages Mechanical harvesting and sorting 


Table 2. Summary of impact experiment for slight bruises in various studies 


Reference Impact method Description of slight impact experiment Impact energy! 
Gao et al. [8] Dropping the apple Drop height: 50 mm; Apple cultivar: Delicious apple 0.071 Joules? 
Zhu and Li [23] Dropping the apple Drop height: 400 mm; Apple cultivar: China Fuji apple 1.023 Joules? 
This study Dropping a steel ball to the apple Steel ball weight: 55 grams; Drop height: 150 mm 0.081 Joules 


‘Calculated with the assumption of no penetration nor bouncing at the contact surface. 
*Estimate from the mean fruit weight of 145.2 grams [38] due to unreported fruit weight. 
3Estimate from the mean fruit weight of 260.9 grams [39] due to unreported fruit weight. 


(a) (b) 


Figure 2. Jazz apple images immediately captured after the bruising experiment with a drop height of 
(a) 150 mm and (b) 300 mm 


2.1.2. Imaging setup 

Figure 3 shows the experimental setup for imaging an apple inside a dark chamber. Four bars of 
Light-emitting diodes (LEDs) were installed to provide normal illumination of the apple. Each LED bar had a 
row of four NIR LEDs and a row of four white light LEDs, see in Figure 4. NIR LEDs were turned on only 
when detecting bruises. In contrast, only white light LEDs were turned on when capturing the color images 
of the apple. Oil-paper was utilized as a light diffuser for the LED bars as shown in Figure 4. 
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Figure 3. Setup for NIR imaging of the apple in a Figure 4. A LED bar for lighting the apple 


dark chamber 
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2.1.3. Characterization of NIR LEDs 

The spectrum of low-cost NIR LEDs used in the experiment was measured by a DLP® NIRscan 
Nano evaluation module, Texas Instrument, with a measuring spectral range from 900 to 1700 nm, and a 
typical 10 nm resolution [40]. As depicted in Figure 5, the spectrum of the NIR LEDs had a peak at about 
954 nm and adequately covered a wide water absorption band centered at about 970 nm [41], [42] Therefore, 
the LEDs used in the experiment were suitable for this study. 
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Figure 5. The spectrum of NIR LEDs used in the system 


2.1.4. Design of experiment 

The design of the experiment is summarized in Table 3. Two types of apples (i.e., French Jazz and 
New Zealand Ambrosia apples) were used in the experiments to evaluate the robustness of the proposed 
approach. For each apple type, bruises were created for two apples at a specific drop height (i.e., 150 mm and 
300 mm), as illustrated by Figure 1. Because this study aims to detect fresh bruises, apple images were 
captured immediately after the apple had been subjected to the bruising experiment. Then, the apple was kept 
at room temperature for the next image capture sessions in 1, 2, and 3 hours. 

For each capture session of an apple, three image sets were obtained. Each image set includes a red, 
green, blue (RGB) and three NIR images. The first image set was obtained by positioning the apple such that 
its bruised area was relatively at the center of its image region. Then, it was slightly rotated to the left and the 
right for capturing the next two image sets. These image sets were necessary to evaluate the robustness of the 
bruise detection algorithm concerning the bruise position. 


Table 3. Summary of design of experiment 


Factors Description 
Type of apples French Jazz, New Zealand Ambrosia 
Drop height h 150 mm, 300 mm 
Number of apples per type and drop height 2 
Time after bruising (hour) 0 (right after intended bruising), 1, 2, 3 
Positions of the bruised area in the image 3 


2.2. Algorithm for bruise detection 

In this study, the Raspberry Pi NoIR camera was used to capture NIR images for bruise detection 
and RGB images for bruise notification. The proposed image processing algorithm for bruise detection 
included three main stages as follows. 


2.2.1. Preprocessing for noise reduction 

After three NIR images had been captured consecutively, their average image was calculated. This 
initial step was to reduce noise in NIR images that were prone to noise due to low light conditions. The 
average image was then scaled down by 30%. A region of interest (ROI) of 1400x1400 pixels in which the 
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apple was centered was cropped from the average image to improve computational cost in the following image 
processing processes. Then, the median filter was applied to the ROI image for further noise reduction Figure 6(a). 


2.2.2. Adaptive contrast enhancement 

By thresholding the ROI image as in Figure 6(a), the apple mask was created as in Figure 6(b). 
From the ROI image and the apple mask, the apple-masked ROI image was created. Contrast limited 
adaptive histogram equalization (CLAHE), which could enhance the image areas with low contrast [43]-[45] 
was then applied to the apple-masked ROI image. The resulting image is the so-called CLAHE image in 
which the contrast of the bruise region was enhanced. As a result, the bruise could be determined to some 
extent visually and intuitively Figure 6(c). 


(a) (b) (c) 


Figure 6. Apple image: (a) Region of interest from the average image, (b) the apple mask, and 
(c) the contrast-enhanced CLAHE image 


2.2.3. Area-based bruise detection 
Figure 7(a) shows the CLAHE image was thresholded, and contour detection was applied. A bruised 
area Apruise Should satisfy the following condition; 


Q < bruise < 02 


’ 


where a; and az are the lower and upper threshold for a bruised area, respectively. In this study, the lower 
threshold a; corresponded to the area of a circle with a 5-mm radius. The upper threshold a2 was chosen to 
conform to a circle area with a radius of 27 mm, the possibly largest impact region, see Figure 1. 

As shown in Figure 7(b), the area-based bruise detection was effective for choosing the right 
contour of the bruised area by removing the large border region of the apple and unexpected noises. Although 
the bruise was created by a ball impactor, its boundary, as observed in Figure 7(b), was noncircular. This 
finding agreed with the report in [27] in which the shape of the bruised region was irregular despite 
considerable impact energy of 0.196 J. Therefore, the area-based threshold for bruise recognition was 
appropriate in this study. The detected bruised area was notified by a green circle in the color image of the 
apple as shown in Figure 7(c). 


(a) (b) (c) 


Figure 7. Area-based bruise detection: (a) thresholded image, (b) detected bruise marked by a yellow circle in 
the thresholded image, and (c) the detected bruise marked by a green circle in the RGB color image 
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3. RESULTS AND DISCUSSION 
3.1. Bruise detection results concerning bruise position 

In the experiment, each apple was placed for imaging such that the intended bruising area was 
relatively at the center, the left and right areas of the apple image. As shown in Figure 8(a)-(f), the apple 
bruise was accurately detected within the intended bruising area previously marked by a blue circle. There 
was a small difference in the bruise’s detected areas (green circles in Figure 8), which might be due to light 
reflection changes when the bruised area was at different positions in the image. This phenomenon agreed 
with the finding that the apple’s inherent surface morphology might affect a VIS-NIR imaging system [46]. 


3.2. Bruise detection results concerning storage time after bruising and drop height 

Figures 9 and 10 illustrate the detection results of Ambrosia and Jazz apples, respectively with 
respect to the storage time after intended bruising at different drop heights. All bruises could be detected 
accurately, although the slighter bruises were not apparent by a brief visual inspection as shown in Figure 2(a). 
Bruises could also be accurately detected right after being subjected to bruising experiments. Within a short 
time of only 3 hours, the bruise areas did not develop sufficiently. As previously discussed, a small difference 
in the detected bruised area might be due to the surface morphology of the apple [46]. 


b) ( 


c) 
(e) (f) 
Figure 8. Bruise detection results of (a)-(c) Jazz apples, and (d)-(f) Ambrosia apples with different imaging 
poses. Green circles show the detected bruise. Intended bruising regions were marked blue 
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Figure 9. Bruise detection results of Jazz apples concerning storage time after intended bruising and drop 
height. Green circles show the detected bruise. Intended bruising regions were marked blue 
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Figure 10. Bruise detection results of Jazz apples concerning storage time after intended bruising and drop 
height. Green circles show the detected bruise. Intended bruising regions were marked blue 


4. CONCLUSION 

A simple and cost-efficient near-infrared imaging system was successfully developed for detecting 
slight bruises induced by only 0.081-Joule impact energy at the early damage stages with 100% detection 
rate. Experimental results showed that similar bruised areas for the same apple were reliably detected in 
terms of storage time for both Jazz and Gala apples. Because the proposed system was simple in terms of 
optical setup and detection algorithm, low-cost in terms of imaging components, it is promising to develop 
cost-effective customer devices to detect fresh bruises in apples and other fruits with soft and thin skin. 
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